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' Abstract 
(N ■ 

I This paper treats of a kind of a gambler's ruin problem, which seeks the probability that a 

C$ . random walker first hits the origin at a certain time. In addition to a usual random walk which 

hops either rightwards or leftwards, the present paper introduces the 'halt' that the walker does not 
t ■ hop with a certain probability. The solution to the problem can be obtained exactly using a Gauss 

hypergeometric function. The moment generating function of the duration is also calculated, and 
cj . a calculation technique of the moments is developed. The author derives the long-time behavior 

O i' of the ruin probability, which exhibits power-law behavior if the walker hops to the right and left 

^ pLi with equal probability. 

> ' 

=3 ! PACS numbers: 05.40.Fb, 02.50.-r 
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^ ; 1 Introduction 

The gambler's ruin problem is a classical subject of probability theory. Consider a random walker on 
' a one-dimensional lattice hopping to the right with probability p^ and left with p^{= 1 — in a 

single time step. The problem seeks statistical properties of duration T x , the time at which the walker 
y—{ , from x first hits the origin. (Of course, T x is a random variable.) Not only a model of bankruptcy [1] 
CN | and gambling [2], but queuing theory [3] and genetic algorithm [3] are concerned with the gambler's 
T 7"! ■ ruin problem. 

A standard textbook of probability theory [5] gives detailed instructions on this problem. The 
^ \ central quantity is the probability P(x, t) that the walker at position x first hits the origin after time 
t. As the solution of the equation P(x, t + 1) = p^.P(x + l,t)+p^P(x — l,t) with initial and boundary 
conditions P(0,0) = 1 and P(x,0) = P(0,t) = (x,t > 1), 

{- I f4_~ |P^i -z ^ 2 p2. +x ^ 2 t and x are of same parity, 
tWJ (i) 
t and x are of the opposite parity. 

The coefficient before p% x )/ 2 p^_ +x )/ 2 i s the number of different paths from x hitting the origin first at 
time t, and it is connected with the reflection principle of a random walk [6]. Obviously, P(x,t) = 
holds when t < x, because (t+x) = 0. 

2 

In statistical physics, a similar problem is called the first passage problem [7]. This is a more general 
problem than the ruin problem, in that the state space of a random walker (or a diffusion particle) 
is not necessarily a one-dimensional lattice but higher-dimensional spaces and networks. Many fields 
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Figure 1: An illustration of the problem. The random walker hops to the right with probability 
and to the left with £><_; hopping does not occur with probability po- +p^- +Po = 1.) The problem 
focuses on statistical properties of the duration T x , which is the time the walker first hits the origin. 

in statistical physics, including reaction-rate theory [8], neuron dynamics [9], and economic analysis 
[lUj . have been formulated and analyzed based on first-passage properties. 

The present paper analyzes an extended form of the classical ruin problem; a random walker 
hops to the right with probability p^, to the left with and it does not hop with probability 
Po = 1 — — p^. Figure [1] schematically shows the problem. The only difference from the original 
ruin problem is that the hatting probability po is introduced. The difference seems very small, but 
the results become quite distinct. In fact, the solution (fTJ) of non halting case (po = 0) is superseded 
by a formula involving a Gauss hypergeometric function in halting case po ^ 0. Moreover, moment 
analysis and asymptotic (long-time) behavior are developed. 

2 Hypergeometric solution 

As in the classical problem described in the previous section, let P(x,t) be the probability that the 
walker starting from x has duration T x = t. P(x, t) satisfies the equation P(x, t + 1) = p^P(x + 1, t) + 
p<-P(x — 1, i) + pqP(x, t) with initial and boundary conditions P(0,0) = 1 and P(x,0) = P(0,t) = 
(x, t > 1). However, it is hard to solve this equation directly, and we take an another way by employing 
a classical result ([T|) effectively 

To calculate P(x,t), we classify the walker's paths according to the number of hopping. We count 
the paths consisting of j hops and t — j halts. First, the different patterns of putting t — j halts into 
t steps are given by (^Zj) in total, where l t — V (not t) comes from the fact that a halting step never 
comes to the last t-th. step. Next, if we focus on only the hopping steps (and ignore the halting steps), 
the paths are reduced to those of classical ruin problem; the probability that the walker from x hits 
the origin after j hops is given by P(x,j). Thus the total occurring probability of a path with j hops 
and t — j halts is 
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Summing up all j, we get 



j) 



j=x 

t 



= E p^W'^t-tI^ • (2) 

j + x even v ' v 7 

In the third equality, the range of summation is changed; the terms corresponding to j > t have no 
contribution because jjzjy^ — 0- In the last equality we change the summation variable as j = x + 2k. 
This result can be also obtained by solving directly the equation P(x,t + l) = p^P(x + l,t)+p^P(x — 
l,t) + p P{x,t) with conditions P(0,0) = 1, and P(x,0) = P(0,t) = (x > 1, t > 1). 

We further proceed with calculation; we rewrite factorials using gamma functions, which is a 
preparatory step toward a hypergeometric function. Employing some formulas of the gamma function, 
one obtains 

1 = 1 T(^ + \ + k)Y{^ + k) 22k 

{t-x-2k)\ r(t + i-x) r(^ + i)r(%i) ' u 

(See Appendix [A] for the calculation in detail.) The probability P(x,t) is expressed as 



x „t— a;. 



P(x,t)=plp 



X 



(t-l)l 



v(x + i)r(t - x + 1) 
r(x + i) ~ r(^ + fe + ±)r(^ + fc ) i / 4p _>p, ^ 



E 



r(^ + i)r(^)^ o r(x + fc + i) *! V p 2 , 



where -F(a, (3; 7; 2) is the Gauss hypergeometric function. This is an explicit form of the solution of 
our problem. This solution cannot be deduced from the non-halting solution ([1]). The hypergeometric 
function in Eq. (j3J) is a genuine hypergeometric function, in the sense that it cannot be expressed using 
simpler functions. (It has been studied that some hypergeometric functions have tractable expressions, 
e.g., F(l/2, l;3/2;-z 2 ) = aT 1 arctanz. [II]) 

We comment here on the convergence of the sum in Eq. — at first sight, it seems to diverge 
when 4p^p^/pQ > 1. By using the Pochhammer symbol (a)k '■= ot(a + 1) • • • (a + k — 1) instead of 
gamma functions, 



P(x,t)=plp t 



(x-l)\(t-x)l^ o (x + l) k kl\ pi 



If x > t, P(x,t) = holds automatically because l/(t — x)\ = 0. On the other hand, if x < t, either 
(^y^)fc or ( x ~2 +1 ) fc becomes zero for > L^pJ • (More precisely, the former becomes zero when x and 
t are of same parity, and the latter becomes zero otherwise.) The sum consists of a finite number of 
terms in reality, so one does not need to worry about the convergence. 

The exact solution ^ is difficult to understand intuitively. We show numerical evaluation of 
P(x, t) in Fig. [2j The initial position of the walker is fixed as x = 50. We separate graphs according 
to the parameter Ap := p<_ — p^.; the panels (a), (b), and (c) respectively correspond to Ap = 0.2, 
0.1, and 0. (Ap is a key parameter for the average duration, as discussed in the following section.) 
P(x, t) is a unimodal function of t for each parameter value. Power-law behavior P(x, t) oc i -3//2 is 
suggested in large t when Ap = (see (d)), which is further discussed in Sec. 01 
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Figure 2: Numerical results of P(x, t) as a function of t (x = 50). The graphs are separated according 
to the value of Ap = — p^: (a) Ap = 0.2, (b) Ap = 0.1, and (c) Ap = 0. The two curves in 
each panel represent p_> = 0.1 and 0.3. Long-time behavior of P(x,t) in Ap = is shown in (d) on 
logarithmic scales, which suggests a power law P{x,t) oc t~ 3 / 2 . 



3 Analysis of moment 

In order to see properties of the random variable T x , moment analysis is developed in this section. 
First, we calculate the moment generating function of T x , defined as 

oo 

M x (s) = ^e st P(x,t). (5) 
t=o 

Calculation process is summarized in Appendix [Bl and the result is 



M x (s) = 




M x {s) contains no special functions, so this is simpler than P(x,t) of Eq. Q. Remarkably, M x (s) 
is described by elementary functions, though its definition ([5]) is an infinite sum of which each term 
contains a genuine hypergeometric function Remarkably, M x {s) contains no special functions, though 
the infinite summation in Eq. ([5]) involves a genuine hypergeometric function via P(x,t). 
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Repeatedly differentiating M x {s) and putting s = 0, we have the first and second moments of the 
duration T x as 



P^-P- 

x 2 \ p^+p- 



^ T ' X ^ (P<- - P^) 2 + 1 (j><r- ~ P~>) 3 P^-P^j X ' 

The average and the other moments remain finite when p^ > and they diverge to infinity as 
— p^ \ 0. The variance of T x is given by 

V(T X ) := (T 2 X ) - (T„> 2 = { /- + % L. 

We can give a plain explanation for the average (T x ). The walker moves to the left by a length 
Ap = — p_^ on average in a single hop. In other words, Ap is a mean velocity of the walker toward 
the origin. Hence, it takes xj Ap time steps on average to reach the origin. 

The moment generating function ([6]) looks too complicated to calculate higher moments by differ- 
entiation. Alternatively, we provide another calculation method for moments of the duration T x . 

We start from the difference equation for P(x,t): 

P(x, t + 1) = p^P{x + 1, t) + p^P(x - 1, t) + p P(x, t). 
Multiply t and take summation for t to get 

oo oo 

tP(x, t + l) = ^2{tp^P(x + 1, t) + tp^P(x - 1, t) + tp P{x, t)} 
t=0 t=0 

= p^{T x+1 ) +p^{T x _i) +p {T x ). 
The left-hand side can be expressed as 

oo oo oo 

tP{x, t+l) = J^(t + l)P(x, t + l)-J2 P ( X ' t + l) = (T x ) - 1. 
t=0 t=0 t=0 

The last equality uses Ylt^=o P{ x > t + 1) = 1) which means that a random walker surely hits the origin. 
(This normalization breaks if p<_ < p_> — see the discussion of total probability of ruin in Sec. [5] in 
more detail.) We have a difference equation 

p^{T x+ i) - (p_> +p^)(T x ) +pi_{T x -i) = -1. 

A particular solution is given by (T x ) = x/(p^ — p_>), and the characteristic equation p_>A 2 — (p~> + 
p^)A + p^ = admits the two roots 1 and p<_/p_>. Thus, the general solution is 

<T«> = — +A + b(^) X , 

P^-P^ \P^J 

which has two constants A and B. In a limiting case p_> — > 0, the problem is still well-defined, and 
(T x ) should be finite, so B = 0. Also, it is obvious that (To) = 0, so A = 0. The appropriate solution 
is therefore 

(T x ) = — ^— . 
P^ -P-y 

Next we calculate the second moment. Multiplying t 2 and taking summation, we derive a difference 
equation 

(T 2 > - 2{T X ) + 1 = p^(T 2 +1 ) +MT|_ 1 ) + p (T 2 ), 
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where we use t 2 = (t + l) 2 — 2(t + 1) + 1 for the calculation on the left-hand side. We assume a 
particular solution in the form (T 2 ) = C2X 2 + C\x, and determine two constants as 

w — 7 > ^2 



(p^-p^) 3 p^-pV (p<_-p_>) 2 ' 

The second moment is 

2 x 2 f p^+p^ 11 x 2 p (l -Po) + 4p_>.p<- 
< T *> = 71 + i 7Z Z vT " Z — t x = 7Z Z~^>. + 7Z Z~^ x - 



(P^-P~>) 2 {(P^-P^) 3 P^-P^j (p^~P->) 2 (P^~P~>) 

The homogeneous-solution part vanishes for the same reason as the average. 

In short, this 'bottom-up' method calculates higher moments inductively, and generally (T£) be- 
comes a polynomial of degree k. For instance, the third moment is calculated as 

Tx ^ (p<- - p^) 3 + 1 (p<- - p~>Y p^-p^i 3x 

| f 2(p<_+p^) 2 + 4p<_p^ 3(p<_+p^) | 1 1 

1 (p«- - p^f Of- - p^) 3 p^-p^j 
4 Asymptotic behavior 

We look at long-time behavior of P(x,t) in this section. In particular, we confirm the power-law 
behavior P(x,t) oc i -3 / 2 mentioned in Sec. [2] when p^ = (see Fig. [2] (d) for reference). 

A summation and factorial, as well as a hyper geometric function, are not suitable to study limiting 
behavior, so we first reexpress the probability P(x,t) into a tractable form. (It may also be possible 
to estimate factorials directly by Stirling's formula.) According to Ref. [5], the solution (pQ) of the 
classic ruin problem has another expression 



P(x, t) = 2 t p^/ 2 p^/ 2 f cos'" 1 TT(f> ■ sin vr0 • sin irx 

Jo 



m- (7) 

This form is convenient in that one does not need to care about the parities of x and t. In fact, the 
integral holds the information of parities: 

fx (t-l)\ 

f + 1 — r /f 1 t and x are 01 same parity, 

/ cos t - 1 7r^-sin7r^-sinvrx^#= ^ 2* (*±*)!(*=£)! v (8) 

^0 otherwise. 

In Appendix [C] we prove this formula. Applying Eq. ([7]) to Eq. ([2]), we have the integral form of the 
probability P(x,t): 



P(x,t) = j2(l_%t j P(x,j) 
j= i V J J 



8111 TT0 ■ 8111 TTX 



)/2 p (l+x)/2 I ^ q + 2^/p^p^ cos vr^)'" 1 sin 7T0 • sin 7rx 
JO 

f 2^/p^p^ c 
po + 2^/p^p 



2p: 

Jo 

2p(i-*)/2p(i+*)/2( po + 2 V P^pT)'- 1 T f PQ + 2 V^^ cos ^y' 1 sin ^ . sin7rx 
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Here we estimate the integral 

* X f PO + lyJP^P^- COS 71"^ 



Sin 7T0 • sin TTX 



PO + 2y/P^P^ 

Po + iJp^p^ cos 7 \ 4-1 .1/ .xz/ 1 , 

sin — • sin — • — dv, 



PO + 2- v /p_>p<_ J t t TTt 

where the integral variable is changed as v = Trt<f) in the second equality. For large t, 

Po + ^Jp^p^ cos j V _1 A yJP^P^- ^ 2 V -1 / JP^P^ v 2 

~ exp 1 



po + 1^/p~^plZ J \ Po + 2^/p^p^ t 2 J ' V Po + 1^/P^pT- t 

Hence the integrand is a rapidly decreasing function of v, and we can extend the upper limit of 
the integration to infinity. Together with the approximation sin(V/£) ~ u/t, we can carry out the 
integration as 

/ * JL r exp ( »-\ vHv = -A= ( P ° + 2 ^^\ ^ t-3/2. 



nt 3 Jo V Po + 2 Vp~^P^ t J A^/tt V 

Therefore, the asymptotic form is expressed as 



3/2 



P(M) - ^(i-^^^ + 2Vp-^)^ ( M + Vgg^ ) 

By the arithmetic mean-geometric mean inequality, we note 

po + 2^/p^p^ < po +£>-► + P<- = 1, 

with equality holding if and only if = p<_ (or Z\p = by the notation in Sec. [2]). Thus, the 
long-time behavior of P(x,t) is completely different according to whether Ap equals zero or not. 

• If Ap / (i.e., p^ / p<-), Po + 2y'p_>.p < _ < 1, and hence P(x,t) asymptotically exhibits 
exponential decay due to (po + 2- v /p_ 5 .p ! _) < . 

• If zip = (i.e., p_> = p^_ =: p), a power law with exponent —3/2 

x -3/2 



{ ' ' 2^p 



is concluded (recall Fig. [2](d)). 



5 Concluding remarks and discussions 

In the present paper, we have solved a gambler's ruin problem where a random walker hops to the 
right with probability p_>, left with p<_, and does not hop with po- We have calculated exactly the 
probability P(x, t) that the walker starting from position x has duration T x = t. The average and 
higher moments of T x are calculated in two ways: by the moment generating function, and by the 
bottom-up calculation. The asymptotic form of P(x, t) is derived, and a power law P(x, t) ~ i -3 / 2 is 
obtained when p_> = p«_. 

We make a brief discussion on the continuum limit, which is an appropriate scaling limit where 
the step width and time interval of the walker tend to zero. Let the step width be 5 and time interval 
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be e, and position and time are scaled as £ = 5x and r = et. In the continuum limit we take d, e — > 0, 
together with 

are both kept finite, i> is the mean displacement per time unit, and D is the diffusioin coefficient 
corresponding to a non-halting (or formally called a simple) random walk. The probability density 
function 

\ ( x t 
p(£, t) = lim -P 



e \S 'e 

is suitable in the continuum limit, rather than the probability distribution P(x,t). ('lim' represents 
the continuum limit.) Carrying out calculation similar to that in Ref. [5], 



y^l - p )Dt 3 V 4(1-jjo)Dt 

is obtained. The probability density p is called the inverse Gaussian distribution [12]. In the continuum 
limit, the halting effect po is reflected only upon the diffusion coefficient as (1 — po)D. Comparing 
P(x, t) of a discrete problem in Eq. and above p(£, r) of a continuum limit, we conclude that the 
discrete random walk is far more difficult than the continuous diffusion, and that the results about 
the discrete random walk in this paper cannot be attained from continuous diffuision problem. 
Combining Eqs. ©, ©, and ©, we get 



Y,^p£ x (lZ]) F (^> x ~l +1 -> x + 1 > 4 * A " 

t=0 



x-ij V 2 ' 2 ' ~' pI J \ 2 p^ V V 2 p 



We have not used the condition p^ + p^ + po = 1 in the derivation of Eqs. (j3J) and ([6]), so p+ 
and po can take any value independently. Set p^ = z/4 and p<_ = po = 1, 



Furthermore, set s= — In 2 (i.e., e _s = 2), 

1 A-A^/i-i + 1 \ ^2-2^ 



00 



t=o 



These formulas are nontrivial, but the author cannot tell whether they are useful in practice. We 
stress that an infinite series of which each term involves a genuine hypergeometric function is hardly 
known. 

We comment on the total probability of ruin. For the discrete problem, putting s = the moment 
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generating function M x (s), 



t=o 



^P(x,t)=M x (0) 

1 -Po 
2p^ 



1 - Po 

2p^ 



Pi 
P- 



2p^ 

P<r- 
P^ 



2p^ 
P*r- < P^- 



If p^- > p->, the gambler surely comes to ruin, but If < p^, the gambler can manage to avoid 
running out of the bankroll with nonzero probability. 

The equation P(x, t + 1) = p^P(x + 1, t) + p^P(x — 1, t) +pqP(x, t) describes a traffic jam, where 
P(x, t) stands for the probability distribution that the jam consists of x cars at time t, and p^ and p<_ 
are involved in the rates at which cars enter and leave the jam. The scaling behavior with exponent 
—3/2 has been observed in the lifetime distribution of jams [13]. We think that results obtained in this 
paper can become theoretical bases; in particular, our discrete problem is comparable to a microscopic 
description of traffic, where discreteness is not negligible. 
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A Calculation of Eq. 

Here we follow the calculation of Eq. (J3j) in detail. Employing the duplication formula T(2z) 
■k- 1 / 2 2 2z ~ 1 T{z)T{z + |), we rewrite 

1 1 ^ 



(t-x-2k)\ T(t-x-2k + l) 2 t - x - 2k T{^-k + \)T(i^-k + l) 
By Euler's reflection formula T{z)T(l — z) = n/ svnitz, 



, t — x , 1 
'— - k+ 2 



1 



7T 



r(fc-^ + i)sinvr(^-A; + i; 

1 (-l) fc 7T 

r(fc-^ + i)sin7r(^ + i) 



(-1)* 



ri*^ + l)r[-- — 

2 2/ V2 2 



Note that sin7r(^rp — k + \) = (— l) fe sin7r(^# + i) because k is an integer. Similarly, 



, t — x 

r [ — — - k + 1 



(-l) fc 

T(k + ^) 



ri^ + iV 



(9) 



(10) 



(11) 



9 



is obtained. Substituting Eqs. (|T0|) and JTT]) into Eq. ([9]), then using the duplication formula again as 



r(— + 2jr(— + i)=^r(*-x + i), 



we eventually come to the result 

i r(^ + i + fc)r(V + &) 2 2, 



(t-x-2fe)i r(t + i-x) r(2f* + i)r(2fS) 
B Calculation of the moment generating function 

We follow here the calculation of Eq. © . Substituting Eq. © into Eq. © 



M x ( S j-2^e 2^P^P<- Po X ( x + k)\k\{t-x-2k)\ 



oo oo 
t=0 k=0 



where a summation variable is changed as r = t — x — 2k in the last equality. Applying the negative 
binomial expansion 

fi \-m (r + m - 1)! 

(1-y) =2^ ^-tt rrfy 

^— ' r!(m — 1)! 

T=0 

with y = Poe s and m = x + 2k, one obtains 

(r + x + 2/c- 1)! _ „ -N-x-2ifc 



£ ^ -(PoeT = (x + 2k - 1)!(1 - p e s 

r=0 

and simplifies Eq. (|12p into 



(x + k)\k\ \e s — Po J 



We can transform as follows using the duplication formula T(2z) = tt~ 1 /' 1 2 2z ~ 1 T{z)Y{z + \), 
{x + 2k-l)\ = T(x + 2k) 

r(- + fe]r — — + k 



vr V2 / V 2 



_r ( x -\ v ( x + l \ r(f + fc)r(^ + fc) o2fc 
n U { 2 J' r(f)r(^) 

r(x) r(f ?r^ +fc) ^- 
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The moment generating function can be expressed by a Gauss hyper geometric function 

00 Wx 1 i.\TVaH-l 1 u\ 1 /o „ \ 2fc 

PO 



M (s) = ( g= V xr(x) r(x + 1) y r (f + fc ) r ('r 1 + fc ) 1 
xls; Ve^-Po/ r(s + 1) r(f )r(2±i) ^ r(x + i + fc) k\\e- s -z 



2 / fc =0 

\ x „ fx x + 1 ^P^Pa 
F -,— — \x+ 1; 



e- s - Po J V 2 ' 2 ' '(e- s -Po)V 
It can be expressed by an elementary function (see Ref. 



,££ + 1 \ / 2 \ x (2- 2^/T 



.2' 2 '~ '7 vi + ^r^ 

This leads to the conclusion. 
C Proof of Eq. 



-j- ^ [ u 1 ) cos ( 2k - t + 1)7T<? 
1 — n \ / 



We calculate the integral to prove Eq. ([8]). We first break up the product of circular functions into 
the sum. 

V 7 fe=0 v 

whose real part is 

t-i 

COS*" 1 7T V 

fc=0 

This is just a Fourier series expansion of cos' -1 9, and is associated with the Chebyshev polynomial 
T n (cosO) := cos n6 [T3]. Moreover, by formulas in trigonometry, 

cos(2/c — t + 1)7T0 • smir<f) ■ s'mirxc/) 

= — {cos(2/c — t + x)7T0 + cos(2/c + 2 — t — x)ii(j) — cos(2/c + 2 — t + x)-7T(j) — cos(2A; — t — x)tt4>} . 
Thus, 



cos' 1 7T(b ■ sin w6 ■ sin irx 



o 



ot+I 5^ \ii {cos(2A; — t + x)tt0 + cos(2/c + 2 — t — x)ir<j) — cos(2fc + 2 — t + x)ir<j) — cos(2/c — t — x)tt 
2 fz^ V k J Jo 



k=0 

Since t, x, and k are integers, the first term in the integral is 



/ cos(2A; — t + x)ir 
Jo 



1 2k - t + x = 0, 
otherwise, 



which behaves like the Kronecker delta S(k, ^-^-) — a subscript fraction may be unreadable, so we use 
5(i,j) instead of the standard symbol 5{ j. The following terms in the integral are also substituted by 
S{k, t - ± f^), S(k, ^ =f=^) ) and S(k, *±*), respectively. 
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If t and x have opposite parity (i.e., t + x and t — x are odd), each Kronecker delta vanishes for all 
integer k. Otherwise, if t and x have same parity, each Kronecker delta becomes nonzero at some k. 
By picking out such k, 

cos'" 1 tt^ ■ sin7T0 • simrx^dcf) = | f**-* 1 ) + ( j+x-2 ) ~ ( t-x-2 ) ~ (W) } 

x (t-l)! 

Therefore, Eq. © is derived. 
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